How well can one resolve the state space of a chaotic map? 
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All physical systems are affected by some noise that limits the resolution that can be attained in 
partitioning their state space. For chaotic, locally hyperbolic flows, this resolution depends on the 
interplay of the local stretching/contraction and the smearing due to noise. We propose to determine 
the 'finest attainable' partition for a given hyperbolic dynamical system and a given weak additive 
white noise, by computing the local eigenfunctions of the adjoint Fokker-Planck operator along 
each periodic point, and using overlaps of their widths as the criterion for an optimal partition. The 
Fokker-Planck evolution is then represented by a finite transition graph, whose spectral determinant 
yields time averages of dynamical observables. Numerical tests of such 'optimal partition' of a one- 
dimensional repeller support our hypothesis. 
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The effect of noise on the behavior of a nonlinear dynam- 
ical system is a fundamental problem in many areas of 
science [1, 2, 3], and the interplay of noise and chaotic 
dynamics is of particular current interest [4, 5, G]. 

The purpose of this letter is two-fold. First, and 
conceptually the most important, we point out an ef- 
fect of noise that has not been addressed in literature: 
weak noise limits the attainable resolution of the state 
space ('phase space') of a chaotic system. We formu- 
late the 'optimal partition' hypothesis whose implemen- 
tation requires only integration of a small set of solu- 
tions of the deterministic equations of motion. Second, 
more technical point; we show that the optimal partition 
hypothesis replaces the Fokker-Planck PDEs by finite, 
low-dimensional Fokker-Planck matrices, whose eigenval- 
ues give good estimates of long-time observables (escape 
rates, Lyapunov exponents, etc.). 

A chaotic trajectory explores a strange attractor, and 
evaluation of long-time averages requires effective parti- 
tioning of the state space into smaller regions. The set 
of unstable periodic orbits forms a 'skeleton' that can be 
used to partition the state space into such smaller regions, 
each region a neighborhood of a periodic point [7, 8] (i.e., 
a point on a periodic orbit). The number of periodic 
orbits grows exponentially with period length, yielding 
finer and finer partitions, with the neighborhood of each 
periodic orbit shrinking exponentially. 

As there is an infinity of periodic orbits, with each 
neighborhood shrinking asymptotically to a point, a de- 
terministic chaotic system can - in principle - be resolved 
arbitrarily finely. However, any physical system suffers 
background noise, any numerical prediction suffers com- 
putational roundoff noise, and any set of equations mod- 
els nature up to a given accuracy, since degrees of freedom 
are always neglected. If the noise is weak, the short-time 
dynamics is not altered significantly: short periodic or- 
bits of the deterministic flow still partition coarsely the 
state space. Intuitively, the noise smears out the neigh- 



borhood of a periodic point, whose size is now deter- 
mined by the interplay between the diffusive spreading 
parameterized [9, 10] by the diffusion constant D, and 
its exponentially shrinking deterministic neighborhood. 
As the periods of periodic orbits increase, the diffusion 
always wins, and successive refinements of a deterministic 
partition of the state space stop at the finest attainable 
partition, beyond which the diffusive smearing exceeds 
the size of any deterministic subpartition. The smearing 
width differs from trajectory to trajectory, so there is no 
one single time beyond which noise takes over; rather, as 
we shall show here, the optimal partition has to be com- 
puted for a given dynamical system and given noise. This 
effort brings a handsome practical reward: as the opti- 
mal partition is finite, the Fokker-Planck operator can be 
represented by a finite matrix. 

While the general idea is intuitive, nonlinear dynamics 
interacts with noise in a nonlinear way, and methods for 
implementing the optimal partition for a given noise still 
need to be developed. In this letter we propose a new 
approach to this partitioning. We compute the width of 
the leading eigenfunction of the linearized adjoint Fokker- 
Planck operator on each periodic point. The optimal par- 
tition is then obtained by tracking the diffusive widths of 
unstable periodic orbits until they start to overlap. We 
describe here the approach as applied to 1 d expanding 
maps; higher-dimensional hyperbolic maps and fiows re- 
quire a separate treatment for contracting directions, a 
topic for a future publication [11]. 

As the simplest application of the method, consider the 
orbit {. . . , a;_i, xo, xi, a;2, . . .} of a 1 d map Xn+i = f{xn), 
and the associated discrete Langevin equation [2] 
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where the ^„ are independent Gaussian random variables 
of mean and variance 2D (the method can be applied 
to continuous time fiows as well, but aid map suffices 
to illustrate the optimal partition algorithm). The cor- 
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responding Fokker-Planck operator [3] , 

= y ^^|=^e pn[x) (2) 

carries the density of Langevin trajectories pn(x) forward 
in time to Pn+i = Pn- Since a density concentrated at 
point Xn is carried into a density concentrated at a;„+i, 
we introduce local coordinate systems Za centered on the 
orbit points Xa-, together with a notation for the map (1), 
its derivative, and, by the chain rule, the derivative of the 
fcth iterate evaluated at the point Xa, 

/: = f'M, f^' = f'a+k-l---fa+lfa, ^ > 2 . (3) 

Here a is the label of point Xa , and the label a + 1 is a 
shorthand for the next point b on the orbit of x^, Xf, ~ 
Xa+i = f{xa)- For example, a period-3 periodic point 
might have label a = 001, and by xqiq = /(a^ooi) the 
next point label is 6 = 010. 

If the noise is weak, we can approximate (to leading 
order in D) the Fokker-Planck operator, £^ o p^ixa+i + 
Za+i) = J dzaCa{za+i, Za)pnixa + Za), by linearization 
centered on Xa, the ath point along the orbit, 

C,{za+^,za) = (47ri^)-V^e- "°^^'^'°""°'^ . (4) 

maps a Gaussian density Pn{xa + Za) = 
Cq exp {— z^/2(T^}, of variance cr^, into a Gaussian den- 
sity pn+i{x) of variance cr^+i = ifa'^a)^ + 2D. This vari- 
ance is an interplay of the Brownian noise contribution 
2D and the nonlinear contracting/amplifying contribu- 
tion [af')"^. The diffusive dynamics of a nonlinear system 
are thus fundamentally different from Brownian motion, 
as the map induces a history dependent effective noise. 

In order to determine the smallest noise-resolvable 
state space partition along the trajectory of Xa, we need 
to determine the effect of noise on the points preceding 
Xa- This is achieved by the adjoint Fokker-Planck oper- 
ator 

o p,,{x) = j -j==e (5) 

which relates a density /5„ concentrated around Xa 
to Pn-i = ° Pm a density concentrated around 
the previous point Xa-i, the variance transforming as 
(/o-iCa-i)^ = '''a + ^i*. For an unstable (expanding) 
map, these variances shrink. After n steps the variance 
is given by 

(,/■:' na„_„)^ = + 2D{1 + ifL-^f + ■■■ + (./r„'+i)') • (6) 

From the dynamical point of view, a good state space 
partition encodes the recurrent dynamics; here we shall 
seek a partition in terms of neighborhoods of periodic 
points [8, 12] of short periods. For the linearized Cl^ 
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FIG. 1: /o,/i: branches of the deterministic map (9) for 
Ao = 8 and b = 0.6. The local eigenfunctions pa,o with vari- 
ances given by (8) provide a state space partitioning by neigh- 
borhoods of periodic points of period 3. These are computed 
for noise variance {D = diffusion constant) 2D = 0.002. The 
neighborhoods A^ooo and A^ooi already overlap, so A4oo can- 
not be resolved further. For periodic points of period 4, only 
Aloii can be resolved further, into A^oiio and Mom- 

acting on a fixed point Xa = fi^a), the ti — > oo sum (6) 
converges to a Gaussian of variance 

al^2D/{Al-l), (7) 

where Aq = and for a periodic point Xa G p to a 
Gaussian of variance 

where Ap = fa''' is the Floquet multiplier (eigenvalue of 
the Jacobian linearized flow) of an unstable (|Ap| > 1) 
periodic orbit p of period rip. This is the key formula; 
note that its evaluation requires no Fokker-Planck for- 
malism, it depends only on the deterministic orbit and 
its linear stability. 

We can now state the main result of this letter, 'the best 
possible of all partitions ' hypothesis, as an algorithm: as- 
sign to each periodic point Xa a neighborhood of finite 
width \xa — aa,Xa + CTa]. Consider periodic orbits of in- 
creasing period Up, and stop the process of refining the 
state space partition as soon as the adjacent neighbor- 
hoods overlap. 

As a concrete application to the Langevin map (1) con- 
sider map [1 2] 

fix) ^ Aox{l~x){l^bx) (9) 

plotted in figure 1; this figure also shows the local eigen- 
functions pafi with variances given by (8). Each Gaussian 
is labeled by the {/o, /i} branches visitation sequence of 
the corresponding deterministic periodic point (a sym- 
bolic dynamics, however, is not a prerequisite for imple- 
menting the method). We find that in this case the state 
space (the unit interval) can be resolved into 7 neighbor- 
hoods 

{Moo,Moii,Moio,Miio,Miii,Mioi,Mioo} ■ (10) 
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FIG. 2: Transition graph (graph whose links correspond to 
the nonzero elements of a transition matrix Tba) describes 
which regions b can be reached from the region a in one time 
step. The 7 nodes correspond to the 7 regions of the optimal 
partition (10). Dotted links correspond to symbol 0, and the 
full ones to 1, indicating that the next region is reached by 
the /o, respectively /i branch of the map plotted in figure 1. 



Evolution in time maps the optimal partition interval 

Moil {A^iio, A^iii}, Moo {A^oo, A^oii, A^oio}, 
etc., as compactly summarized by the transition graph 
of figure 2. 

Next we show that the optimal partition enables us to 
replace Fokker-Planck PDEs by finite-dimensional matri- 
ces. The variance (8) is stationary under the action of 

tn 

Ca and the corresponding Gaussian is thus an eigen- 
function. Indeed, for the linearized flow the entire eigen- 
spectrum is available analytically, and will be a key in- 
gredient in what follows. For a periodic point Xa G p, 
the ripth iterate Ca'' of the linearization (4) is the dis- 
crete time version of the Ornstein-Uhlenbeck process [13], 
with left po, pi, • • •, respectively right po, pi, ■ ■ ■ mutually 
orthogonal eigenfunctions [■!] given by 



Pa.kiz) 
Pa.k{z) 



k+l 



1 



(11) 



where Hk{x) is the fcth Hermite polynomial, 1//3 = 
V2aa, and the fcth eigenvalue is l/jAjA'^. 

Partition (10) being the finest possible partition, the 
Fokker-Planck operator now acts as [7 x 7] matrix with 
non-zero a — > 6 entries expanded in the Hermite basis. 



= {PbM^lPa.j) 
dZfydZa /3 



X Hkil3zb)Hj{l3za) 



(12) 



where 1//3 = and Za is the deviation from the 

periodic point Xa- It is the number of resolved periodic 
points that determines the dimensionality of the Fokker- 
Planck matrix. 

Periodic orbit theory [12, 14] expresses the long-time 
dynamical averages, such as Lyapunov exponents, escape 
rates, and correlations, in terms of the leading eigenval- 
ues of the Fokker-Planck operator £. In our 'optimal 
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FIG. 3: (left scale) the escape rate of the repeller (9) vs. the 
noise strength D, calculated using (□) the 'optimal partition', 
and (x) a uniform discretization (16) in A'^ = 128 intervals; 
(right scale) the Lyapunov exponent of the same repeller vs. 
D, estimated using (•) the 'optimal partition', and (o) the 
average (17). 



partition' approach, C is approximated by the finite- 
dimensional matrix L, and its eigenvalues are determined 
from the zeros of det(l — zL), expanded as a polynomial 
in z, with coefficients given by traces of powers of L. As 
the trace of the nth iterate of the Fokker-Planck operator 
£" is concentrated on periodic points f"'{xa) — Xa, we 
evaluate the contribution of periodic orbit p to tr L"'' by 
centering L on the periodic orbit. 



trLn 



Lr/)L 



cb'-'ba , 



(13) 



where Xa,Xb, ■ ■ ■ Xd S p are successive periodic points. 
To leading order in the noise variance 2D, tp takes the 
deterministic value tp = l/|Ap — 1|. 

We illustrate the method by calculating the escape 
rate 7 — — Inzo, where Zq^ is the leading eigenvalue of 
Fokker-Planck operator C , for the repeller plotted in fig- 
ure 1 . The spectral determinant can be read off the tran- 
sition graph of figure 2, 

det(l - 2L) = 1 - (to + ti)z - {toi - toti) z^ 

— (^001 + ^011 ^ ^01^0 — toiti) z^ ~ ■ ■ ■ 

— (iooioiii + ^0011101 — • • • + tooitoiiti) z"^ . (14) 

The polynomial coefficients are given by products of non- 
intersecting loops of the transition graph [12], with the es- 
cape rate given by the leading root Zq^ of the polynomial. 
Twelve periodic orbits 0, T, OT, 001, OTT, OOTT, OTTT, 
OOm, 001101, 001011, 0010111, OOlllOl up to period 7 
(out of the 41 contributing to the noiseless, determinis- 
tic cycle expansion up to cycle period 7) suffice to fully 
determine the spectral determinant of the Fokker-Planck 
operator. The 'optimal partition' estimate of the Lya- 
punov exponent is given [12] by A = (In A) / (n), where 
the cycle expansion average of an observable A 

{A) = Aoto + Aiti + {Aoitoi - [Ao + Ai)toti) + 

(^ooiiooi - (^01 + Ao)toito) + ■■■ (15) 
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is the finite sum over cycles contributing to (14), and 
InAp = X] l/'(^a)| sum over the points of cycle p is 
the cycle Lyapunov exponent. 

Since our 'optimal partition' algorithm is based on a 
sharp overlap criterion, small changes in noise strength D 
can lead to transition graphs of different topologies. We 
assess the accuracy of our finite Fokker-Planck matrix ap- 
proximations by discretizing the Fokker-Planck operator 
C with a piecewise-constant approximation on a uniform 
mesh on the unit interval [15], 

where M.i is the ith interval in equipartition of the unit 
interval into N pieces. Empirically, N = 128 inter- 
vals suffice to compute the leading eigenvalue of the dis- 
cretized [128 x 128] matrix [C]ij to four significant digits. 
The Lyapunov exponent is evaluated as the average 

A = J dxe'^p{x)\n\f'{x)\ (17) 

where p{x) is the leading eigenfunction of (16), 7 is the 
escape rate, and p is the normalized repeller measure, 
/ dx p{x) ~ 1. The numerical results are summarized 
in figure 3, with the estimates of the 'optimal partition' 
method within 1% of those given by the uniform dis- 
cretization of Fokker-Planck. 

In summary, we have presented a new method for par- 
titioning the state space of a chaotic repeller in the pres- 
ence of noise. The key idea is that the width of the 
linearized adjoint Fokker-Planck operator C\ eigenfunc- 
tion computed on a periodic point Xa provides the scale 
beyond which no further local refinement of state space 
is possible. This computation enables us to systemati- 
cally determine the optimal partition^ of the finest state 
space resolution attainable for a given chaotic dynamical 
system and a given noise. Once the optimal partition 
is determined, we use the associated transition graph to 
describe the stochastic dynamics by a finite dimensional 
Fokker-Planck matrix. While an expansion of the Fokker- 
Planck operator about periodic points was already intro- 
duced in ref. [IG], the novel aspect of this work is its 
representation in terms of the eigenfunctions of the lin- 
earized Fokker-Planck operator (4), ie. the Hermite ba- 
sis [10, 11]. 

We test our optimal partition hypothesis by applying it 
to evaluation of the escape rate and the Lyapunov expo- 



nent of a Id repeller in presence of additive noise. Numer- 
ical tests indicate that, the 'optimal partition' method 
can be as accurate as a 128- interval discretization of the 
Fokker-Planck operator. 

The success of the optimal partition hypothesis in a 
1-dimensional setting is encouraging. However, higher- 
dimensional hyperbolic maps and flows, for which an ef- 
fective optimal partition algorithm would be very useful, 
present new challenges due to the subtle interactions be- 
tween expanding, marginal and contracting directions. 
The nonlinear diffusive effects (weak stochastic correc- 
tions [10]) need to be accounted for as well. These issues 
will be addressed in a future publication [] ].]. 

We are indebted to CP. Dettmann, W.H. Mather, 
A. Grigo and G. Vattay for many stimulating discussions, 
and S.A. SoUa for a critical reading of the manuscript. 
P.O. thanks Glen P. Robinson and NSF grant DMS- 
0807574 for partial support. 



[1] N. G. van Kampen, Stochastic Processes in Physics and 
Chemistry (North-Holland, Amsterdam, 1992). 

[2] A. Lasota and M. MacKey, Chaos, Fractals, and Noise; 
Stochastic Aspects of Dynamics (Springer- Verlag, Berlin, 
1994). 

[3] H. Risken, The Fokker-Planck Equation (Springer- 
Verlag, 1996). 

[4] R Gaspard, J. Stat. Phys. 106, 57 (2002). 

[5] H. C. Fogedby, Phys. Rev. Lett. 94, 195702 (2005). 

[6] H. C. Fogedby, Phys. Rev. E 73, 031104 (2006). 

[7] D. Ruelle, Statistical Mechanics, Thermodynamic For- 
malism (Addison- Wesley, Reading, MA, 1978). 

[8] P. Cvitanovic, Phys. Rev. Lett. 61, 2729 (1988). 

[9] H. Dekker and N. V. Kampen, Physics Lett. 73A, 374 
(1979). 

[10] P. Gaspard, G. Nicolis, A. Provata, and S. Tasaki, Phys. 

Rev. E 51, 74 (1995). 
[11] D. Lippolis and P. Cvitanovic, in preparation, 2009. 
[12] P. Cvitanovic, R. Artuso, R. Mainieri, G. Tanner, and 

G. Vattay, Chaos: Classical and Quantum (Niels Bohr 

Institute, Copenhagen, 2009), ChaosBook.org. 
[13] G. E. Uhlenbeck and L. S. Ornstein, Phys. Rev. 36, 823 

(1930). 

[14] P. Gaspard, Chaos, Scattering and Statistical Mechanics 
(Cambridge Univ. Press, Cambridge, 1997). 

[15] S. M. Ulam, A Collection of Mathematical Problems (In- 
terscience Publishers, New York, 1960) . 

[16] P. Cvitanovic, N. S0ndergaard, G. Palla, G. Vattay, and 
C. Dettmann, Phys. Rev. E 60, 3936 (1999). 



